10/582725 

WO 2005/057498 PCT/SG2003/000284 

1AP20 Rec'd PCT/PTO 12 JUN 2006 

1 

Method and Apparatus for Identifying Pathology in Brain Images 
Field of the Invention 

The present invention relates to a method and apparatus for identifying 
pathology in brain images, such as brain tumours in neurological images. 

5 Background of the Invention 

Computer-assisted surgical planning and advanced image-guided technology 
are increasingly used in neurosurgery, as the availability of accurate 
anatomical 3-dimensional models improves considerably the spatial 
information concerning the relationships of important structures. In addition, 
10 the importance of computer-aided diagnosis in neuroradiology is growing. At 
the same time, brain databases are expanding rapidly and the technology to 
analyse these images efficiently, particularly for large databases, is 
progressing. 

The identification of brain tumours has conventionally been achieved through 
15 segmentation using knowledge-based systems or an atlas, as set out in Kaus 
MR et al "Automated segmentation of MR images of brain tumours" Radiology 
2001; 218(2): 586-591; Fletcher-Heath LM et al, "Automatic Segmentation of 
non-enhancing brain tumors in magnetic resonance image," Artificial 
Intelligence in Medicine 2001; 21(1-3): 43-63; and Clark MC et al, "Automatic 
20 tumor segmentation using knowledge-based technique" IEEE Transactions on 
Medical Imaging 1998; 17(2): 187-201. 

U.S. 4, 856,528 discloses a computer-implemented arrangement for semi- 
automatically determining the volume of a tumour from CT image data. A 
histogram indicative of the number of pixels within the organ outline of 
25 respective slices is produced. The distinction between the tumour tissue and 
normal organ tissue is determined enabling determination of the volume of the 
tumour. 
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WO 02/43003 discloses a system for analysing a brain image. The brain 
image is compared with a brain atlas and the image is labelled accordingly, 
and annotated with regions of interest and/or other structures. 

Eur J Radiol 2003 Mar; 45(3):1 99-207 entitled "Characterization of normal 
5 brain and brain tumor pathology by chisquares parameter maps of diffusion- 
weighted image data" Maier SE, Mamata H v Mulkern RV, Dept. of Radiology 
(MRI), Brigham and Women's Hospital, Harvard Medical School, 75 Francis 
Street, 02115 Boston MA, USA discloses the test results of a characterisation 
of normal and pathologic brain tissue by quantifying the deviation of a 
10 diffusion-related signal from a monoexponential decay when measured over a 
range of b-factors. 

The present invention is directed to identifying pathology in medical images 
and automated scan interpretation. This is critical when searching large brain 
databases and the present invention aims to provide a method for fast 
15 identification of pathology in images. The method is particularly 
advantageous in situations where there is a need to identify the presence of 
pathology before model-based approaches may be applied. The pathology 
may then be localised and segmented prior to the application of such model- 
based approaches. 

20 Summary of the Invention 

According to a first aspect of the present invention there is provided a method 
for identifying pathology in a brain image comprising the steps of: 

(a) determining the location of the midsagittal plane (MSP) by 
calculating up to 16 approximated fissure line segments (AFLSs) 
25 and removing outlier AFLSs, the outlier AFLSs having a larger 

angular deviation from the MSP than a predefined threshold; 
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(b) calculating the ratio of the number of outlier AFLSs to the 
number of inlier AFLSs, the inlier AFLSs having a smaller 
angular deviation from the MSP than the predefined threshold; 
and 

5 (c) comparing the ratio with a further predetermined threshold 

value, the ratio exceeding the further predetermined threshold 
value when pathology is present in the brain image. 

Preferably, the image comprises image data and the method further 
comprises the step of: 

10 (d) reformatting the image data to align the image with the MSP. 

Preferably, the reformatting is performed using vector manipulation, and the 
midsagittal plane has an equation x'+d-O where x' is a co-ordinate in the OX 
direction and d' is a constant, the image having an original co-ordinate system 
OXYZ before reformatting and a reformatted co-ordinate system after 
15 reformatting comprising co-ordinates 0'X\ OT and 0'Z\ the step of 
reformatting comprising: 

(i) starting with an MSP equation : 

ax + by + cz +d = 0, 

where d is less than 0 and (a.b.c) is the unit normal vector of the MSP; 

20 (ii) determining two points that are the intersections between the MSP and 

the volume of the brain shown in the image under examination, 
denoting the two points as A (x*, y A , 0) and (xb, y B , 0), both of the two 
points being on the MSP; 

* 

(Hi) when a is not equal to 0, calculating A and B as follows: 
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xa = -d/a, y A = 0 
xb = -(d+b(ySize -1))/a, y B =ySize - 1 

where ySize is the number of voxels in the Y direction of the original volume; 

(iv) when a is 0, b should not be 0, and calculating A and B as follows: 

5 xa = 0, y A = -d/b 

xb = x Size -1 , y B = -(d + a(xSize -1 ))/b 

where xSize is the number of voxels in the X direction of the original 
volume; and 

(v) changing the original coordinate system OXYZ to the reformatted co- 
10 ordinate system O' X* Y'Z\ the unit vectors of the co-ordinates O'X', 

OV and O'Z' being calculated in the following manner 

0'X' = (a, b, c) = (n x1 ,n y1 ,n z1 ) 

OT = ((xA-xB)/ A-B , (yA - yB)/ A-B ,0) = (n*. n*. n*) 

O'Z* = O'X'xO'Y = (n^, (\y3, n*) 

15 where A-B is the Euclidean distance between points A and B, the 

transformation between OXYZ and O'XTZ' being defined as follows: 

X = n x i X + n y i Y + n z1 Z 

T-r\ra X + ny2Y+ n^Z 

Z' = nx3 X + nyaY + n^Z 



20 



O' = 0. 
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In a preferred embodiment, the method further comprises the step of 
processing one or more slices through the image to determine 
interhemispheric symmetry. 

Preferably, the step of processing comprises processing one or more slices 
5 having a plane substantially perpendicular to the midsagittal plane. 

Preferably, the step of processing comprises processing one more slices 
having a plane which intersects the midsagittal plane. 

Preferably, the image comprises data representing the brain and background 
image data, the step of processing comprising extracting the background 
10 image data and retaining the data representing the brain. 

Preferably, the image is comprised of a number of pixels, the step of 
extracting comprising calculating a histogram of grey level of the image along 
a first axis, for example the x-axis, against the number of pixels of the image 
along a second axis, for example the y-axis, locating a first peak in the 
15 histogram formed at the intersection of a positive slope and a negative slope, 
extrapolating the approximating the positive slope back to intersect the first 
axis and taking the value of grey level at the intersection of the positive slope 
with the first axis as a threshold grey level value. 

In a preferred embodiment, the step of processing comprises further 
20 processing the image to obtain a binary image by setting the pixels having a 
grey level greater than the threshold grey level to 1 and the pixels having a 
grey level lower than the threshold grey value to 0. 

Preferably, the image depicts the brain and a skull, the method further 
comprising the steps of opening the binary image with a structuring element of 
25 pixels and expanding the structuring element to fill the image of the skull to 
produce a head mask. 
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Preferably, the method further comprises cropping the image to the head 
mask to remove the background data visible in the image. 

Preferably, the method further comprises calculating a histogram of grey level 
of the image along a first axis against the number of pixels of the image along 
5 a second axis for each hemisphere, smoothing the histogram for each 
hemisphere, comparing the histograms of the two hemispheres by calculating 
the difference between the histograms. 

Preferably, the step of calculating the difference in values between the 
histograms comprises calculating a difference function between the values of 
10 the histograms for all grey levels. Preferably, the difference function has a 
maximum value and a minimum value, the method further comprising 
identifying when the difference between the maximum value and the minimum 
value exceeds a threshold difference value to indicate pathology presence in 
the brain under examination. 

* 

15 There are more ways to calculate this difference in values between the 
histograms, for example, from the: 

- absolute difference between the histograms 

- difference of their areas 

- normalized difference of their areas (e.g., by half of their sum) 

20 In addition, before calculating the histogram difference, the histograms may 
be aligned horizontally, for instance, by maximizing their cross-correlation. 

In a preferred embodiment, the method further comprises determining the 
extent of pathology in the brain under examination. Preferably, the step of 
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determining extent of pathology comprises determining the ratio of the 
number of slices with pathology to the total number of slices studied. 

Preferably, the method further comprises determining the location of the 
pathology. Preferably, the step of determining the location of the pathology 
5 comprises locating the hemisphere that contains pathology. Preferably, the 
step of locating comprises determining the modality of histograms for both 
hemispheres of the brain under consideration, tri-modality existing for both 
hemispheres being an indication of a small pathology existing in one or both 
hemispheres. 

10 In a preferred embodiment the method comprises determining if one or both 
of the hemispheres is not tri-modal indicating pathology existence therein and, 
if one or both of the hemispheres is not tri-modal determining the modality of 
the histograms for each slice. Preferably, the method further comprises 
determining if tri-modality exists for all of the slices within both hemispheres, 

15 and if it does not exist determining if the ratio of the number of the outlier 
AFLSs to the number of the inlier AFLSs, is greater than the further threshold 
value to indicate existence of pathology which is crossing the 
interhemispheric fissure. 

If tri-modality exists for all of the slices within both hemispheres, and if it does 
20 not exist, the method preferably further comprises determining if the ratio of 
the number of the outlier AFLSs to the number of inlier AFLSs is less than the 
further threshold value to indicate existence of pathology in both hemispheres. 

According to a second aspect of the present invention there is provided an 
apparatus arranged to perform the method for identifying pathology in a brain 
25 image defined above. 

According to a third aspect of the invention there is provided a computer 
program product comprising computer program instructions readable by a 
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computer apparatus to cause the computer apparatus to perform the method 
defined above. 

The present invention provides a method for fast identification of pathology 
such as brain tumours in neuro images. Preferred embodiments of the 
5 method test two features, linearity of the interhemispheric fissure and image 
symmetry for both hemispheres. 

Brief Description of the Drawings 

The present invention will be described by way of example and with reference 
to the accompanying figures in which: 

10 Figure 1 is a flow diagram showing the six steps in an embodiment of a 
method according to the invention for identifying tumours in a brain being 
examined; and 

Figure 2 is a flow diagram showing the procedure involved in the sixth step 
illustrated in Figure 1 for locating a tumour. 

15 Description of Preferred Embodiments 

An embodiment of the present invention provides a fast, automatic, accurate 
and robust method for extracting pathology of, for example, a human or 
animal brain, from three-dimensional radiological images such as CT or MRI 
images. The steps constituting a preferred embodiment of the method are 
20 shown in the flow diagram of Figure 1. The method of the present invention 
will be discussed in more detail after a brief discussion of these steps. 

The processing steps, illustrated in the flow diagram of Figure 1 are as 
follows: 



WO 2005/057498 



PCT/SG2003/000284 



9 

1 . The first step is to calculate the midsagittal plane (MSP), for example, using 
the methods described in the patent applications PCT/SG02/00006 and 
PCT/SG02/00231 both by Hu and Nowinski. 

2. The second step is to calculate the ratio of the number of outlier AFLSs 
5 to the number of inlier AFLSs to signal a potential existence of pathology 

when the outliers-to-inliers ratio is above a certain threshold. 

3. The third step is to reformat, if necessary, the original slices to be 
perpendicular to the MSP. 

4. The fourth step is, for each image, to: 
10 (a) extract the head from the image; 

(b) crop the image to contain the head only and set the background to 
zero; 

(c) calculate a histogram for each hemisphere; 

(d) smooth the calculated histograms; 

15 (e) calculate additional features of the hemispheres, such as intensity 
mean, moments, cross-correlation, and mutual information; 

(f) compare the histograms for the two hemispheres, preferably with 
additional features and if their difference is larger than a certain threshold, 
signal the existence of pathology; 

20 5. The fifth step is to calculate the pathology ratio. 
6. The sixth step is to locate pathology. 
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Figure 2 shows a flow diagram of the stages involved in the sixth step of 
Figure 1 for determining whether or not pathology exists in both hemispheres 
or lobes of a brain being examined. 

The algorithm illustrated in Figure 1 has six major steps which are set out 
5 below: 

Step jkCajcujate the midsaqittal plane (MSP) 

The midsagittal plane (MSP) is calculated using the algorithm described in the 
applicant's co-pending International patent application number 
PCT/SG02/00006 filed on 18 January 2002 and entitled "Methods and 

10 apparatus for determining symmetry in 2D and 3D images" which describes 
methods for determining the MSP of human brains from radiological images. 
The algorithm described in International patent application number 
PCT/SG02/00006, the content of which is incorporated herein by reference, 
provides a rapid, accurate, and automatic calculation of the MSP and enables 

15 determination of the equation of the MSP which divides the brain image data 
into two hemispheres. By this method, the up to 16 approximated fissure line 
segments (AFLSs) are extracted and used to calculate the MSP. These 
AFLSs are then compared with the calculated MSP to find outlier and inlier 
AFLSs. Those AFLSs with an angular deviation from the MSP bigger than a 

20 predefined threshold are considered outlier AFLSs, while the rest are taken as 
inlier AFLSs. 

Step 2: Calculate the out»ers-to-lnllers ratio Ir) 

The ratio (r) of the number of outliers to the number of inliers is calculated. 
The existence of outliers means that some of the interhemispheric fissure line 
25 segments may be far from one common interhemispheric fissure plane. 
There are two major reasons for this, namely, an intrinsic curvature of the 
(normal) brain and/or a pathology process that distorts the interhemispheric 
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fissure. To measure this distortion, the outliers-to-inliers ratio (r) is introduced 
and applied in step 2.1 , as follows. 

Step 2.1:Compare the outller-to-inliers ratio with a given threshold 

When r = 0, there are no outliers and the interhemispheric fissure forms 
5 almost an ideal plane. On the other hand, if r = 1 this means that the number 
of outliers equals the number of inliers and therefore the interhemispheric 
fissure is curved or distorted. A suitable threshold (Tr) is set experimentally 
between 0 and 1. When r is greater than Tr, the method signals a potential 
existence of pathology. The processing of the images continues to check the 
10 symmetry of the images. This MSP linearity condition is also used in step 6 
when localising pathology which is described below. 

Step 3: Reformat data 

The anatomy of a normal brain is approximately symmetrical with respect to 
the interhemispheric fissure. To test the symmetry, images have to be 

15 available in a plane perpendicular to the MSP. If the originally acquired data 
are not perpendicular to the MSP, the data have to be reformatted. Either 
axial or coronal sections may be generated (or taken if they exist) for further 
processing. The reformation of data may be carried out in the following way 
so that the reformatted volume of the brain under consideration will have an 

20 MSP equation x' + d' = 0. 

If the original MSP equation is 

ax + by + cz +d = 0, 

where d is less than 0 and (a,b,c) is the unit normal vector of the MSP, then 
the following steps are performed. 
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a) Find two points that are the intersections between the MSP and the 
original volume, then denote these two points as A (xa, yA, 0) and (x B , 
y B , 0). Both of these two points are on the MSP. 

When a is not equal to 0, A and B may be calculated as follows, 
5 XA=-d/a, y A =0 

xb = -(d+b(ySize -1 ))/a, y B =yS ize - 1 

where ySize is the number of voxels In the Y direction of the original volume. 

When a is 0, b should not be 0, A and B can be determined in a similar way: 

Xa =0,y A = -d/b 
10 x B = x Size -1 , y B = -(d + a(xSize -1 ))/b 

Where xSize is the number of voxels in the X direction of the original volume. 

b) If the original coordinate system OXYZ is changed to O' X 1 YT, the unit 
vectors of 0'X\ O'Y* and OT are calculated in the following manner: 

(yXMa. b, c) = (n x i t n y i,n 2 i) 

15 OT = ((xA-xB)/ A-B , (yA - yB)/ A-B ,0) = (n^. n^, n^) 

OT = O'X'xOT = (n x3 , n y3 , n&) 

where A-B is the Euclidean distance between points A and B. 

c) The transformation between OXYZ and O'XTZ 1 is thus defined as 
follows: 

20 X 1 = n x i X + n y1 Y + n z i Z 
r = nx2X + n y2 Y + ri 2 2Z 
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Z = n X 3 X + nyaY + rizaZ 

* 

O' = 0 

Step 4: Process Images 

The individual axial or coronal images are processed to determine 
5 interhemispheric symmetry. Processing individual images increases 
robustness in comparison to processing the entire hemispheres. 

Step 4.1: Extract head 

Firstly the head is extracted from the image. The background image area 
(outside the head) is set to zero. The head may be extracted through 

10 thresholding and morphological processing, for example, as described in the 
applicant's co-pending International patent application number 
PCT/SG03/00043 filed on 27 February 2003 and entitled "Method and 
apparatus for extracting the human cerebral ventricular system from images", 
the content of which is incorporated herein by reference. The histogram of 

15 the image is calculated and the first peak of the histogram is located. The use 
of a triangle to approximate the histogram shape around the peak of the 
histogram may produce the bottom of the peak and that value is taken as the 
threshold. However, a Gaussian or other appropriate method may be used 
instead of a triangle for this purpose. Thresholding the image to produce a 

20 binary image may be achieved by setting all pixels with a grey level greater 
than the threshold to 1 and the rest to 0. 

The morphological processing applied to the binary image after thresholding 
comprises opening the binary image with a square structuring element of, for 
example, four pixel sizes, to fill small broken skull. The largest component of 
25 the binary image is located and the holes within this image are filled to obtain 
the head or head mask. 
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Step 4.2:Crop the image to the head 

* 

The image is cropped to the head from all four directions. This is to eliminate, 
firstly, a potential influence of the background on the histogram comparison 
due to, for example, the non-central location of the head within the image, and 
5 secondly, to speed up the generation of the histograms by decreasing the 
number of pixels processed. 

Step 4.3: Calculate histogram for each hemisphere 

For each left and right hemisphere its histogram is calculated. 
Step 4.4: Histogram smoothing 

10 A histogram may contain a number of spikes due to noise. Prior to histogram 
comparison, a histogram smoothing operation is applied by using, for 
example, a procedure employed in the ventricular system extraction algorithm 
described in the applicant's co-pending International patent application 
number PCT/SG03/00043 filed on 27 February 2003 and entitled "Method and 

15 apparatus for extracting the human cerebral ventricular system from images", 
the content of which is incorporated herein by reference. 

Step 4.5: Histogram comparison 

It has been appreciated by the applicant that symmetric hemispheres should 
have similar histograms and comparing histograms is a more efficient way of 
20 matching hemispheres than comparing the images pixel by pixel. 

A fast histogram comparison is achieved by calculating the difference 
between the histograms being compared. The difference between histograms 
is computed by calculating a difference function between their values for all 
grey levels. The minimum and maximum of this function is determined. 
25 When the difference between the maximum and minimum is beyond a given 
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threshold Th (which may be determined experimentally for normal brains), this 
image is marked as pathological and the method signals the existence of 
pathology. The histogram comparison is not sensitive to a vertical shift 
between histograms. 

5 There are more ways to calculate this difference in values between the 
histograms, for example, from the: 

- absolute difference between the histograms 

- difference of their areas 

- normalized difference of their areas (e.g., by half of their sum) 

10 In addition, before calculating the histogram difference, the histograms may 
be aligned horizontally, for instance, by maximizing their cross-correlation. 

A more sophisticated comparison of histograms may involve fitting multiple 
Gaussians into these histograms and comparing their mean values and 
standard deviations. An example of such a technique is described in the 
15 applicant's co-pending International patent application number 
PCT/SG03/00043 filed on 27 February 2003 and entitled "Method and 
apparatus for extracting the human cerebral ventricular system from images", 
the content of which is incorporated herein by reference. 

Prior to histogram comparison, the image may be corrected for non- 

m 

20 homogeneity, if necessary. 

Step 5: Calculate pathology ratio 

The pathology ratio is calculated as being the ratio of the number of slices 
containing pathology to the total number of slices studied. This ratio gives an 
extent of pathology within the data. 
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Step 6: Pathology location 

After identifying pathology, an embodiment of the method according to the 
present invention provides additional information about the location of 
pathology. The first step is to locate the hemisphere that contains pathology. 
5 The histogram for a normal brain anatomy has three distinctive peaks, one 
peak for cerebrospinal fluid, one for grey matter, and one for white matter (the 
background set to zero is not considered). This is termed lii-modality*. A 
hemisphere with pathology may not fit to this model, and may have, for 
example, an additional peak. 

10 The sub-steps for determining the location of pathology are illustrated in the 
flow diagram of Figure 2. The first sub-step is to determine the modality of 
volume histograms for both hemispheres of the brain under consideration. 

If tri-modality exists for both hemispheres, then a small pathology exists in 
one or both hemispheres. If one or both of the hemispheres is determined not 
15 to be tri-modal, then pathology exists therein and the modality of the 
histograms for each slice showing pathology is determined. 

If tri-modality exists for all slices within both hemispheres the data are normal 
and it may be assumed that the threshold Th (determined in step 4.5) was 
probably too low. If tri-modality does not exist for all of the slices within both 

20 hemispheres, and the outlier-to-inlier ratio r is greater than the threshold Tr 
(determined in step 2), then pathology exists which is crossing the 
interhemispheric fissure. If tri-modality does not exist for all of the slices 
within both hemispheres, and the outlier-to-inlier ratio r is less than the 
threshold Tr (determined in step 2), then pathology exists in both 

25 hemispheres. 

The next step is to locate a pair of lobes containing pathology. Sub-steps 4.1 
to 4.5 described above are then repeated for each pair of all lobes as 
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opposed to the complete head. Repeating operations from Figure 2 for a pair 
of lobes enables selecting the lobe or lobes with pathology. 

The method of the invention may be supplemented with other features used 
instead of or together with the histograms. The other features may include 
5 mean intensity value, cross-correlation, moments, and mutual information 
calculated for both hemispheres. This enables the comparison between both 
hemispheres to be performed using any of these features and it need not be 
limited only to the histograms and various ways of calculating their difference. 

The method according to an embodiment of the invention is able to identify 
10 pathology in brain images and localise this pathology with respect to 
hemispheres and lobes. The method is fully automatic and very fast and 
enables screening of a large number of brain images for pathology, in 
particular brain tumours. 

The method has applications in a number of fields including, for example, 
15 neurosurgery and neuroradiology. 



